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Individual differences in the self-regulation of Lamina 
emerging from thinking aloud protocols 

1) 

dr. P.R.J. Simons 
Tilburg University 
Department of psychology 
Fostbex 90153 
5000 LE Tilburg 
The Netherlands 

Abstract 

After the presentation of the beginnings of a theory on the 
self -regulation of learning, three studies are reported on 
individual differences in regulation-processes, emerging from 
thinking aloud protocols. Protocols of good and weaker performing 
Ss were compared and related to tastscores (impulsivity intelli- 
gence (etc). Furthermore, students were trained to change their 
regulation-processes. Training programs consisted of a combina- 
^i 0 "^ 1 awareness - tra ining and regulation-training. The Ss were 
14, 10 and 6 students from a normal secondary school and two 
special secondary schools (for children with learningpreblems ) 
respectively. The results showed some relations between process- 
differences such as the quality and quantity of testing-proces- 
ses, the bread tn of orientation, on-line regulation and mind- 
orientation on the one hand and performance on the other hand 
There were also influences of task difficulty on the process- 
data. Training appeared to be effective for some off the students 
only. Transfer effects failed to show up. 



Introduction 



Underlying the research to be reported in this paper is a 
theoretical framework derived from theories of Boekaerts (1982) 
Brown (1980), Gagne (1977), Hettema (1979), Klauer (1985), Kuhl 
(1983) and Lawson (1984). According to this framework the self- 
regulation of learning is defined as the number and kinds of 
teaching tasks students perform themselves. Figure 1 presents the 
various teaching tasks. 

The first teaching task (preparing students) has subtasks 
borrowed from Gagne (1977) and Galperin (1964). The second task 
(facilitating learning) is formulated in accordance with propo- 
sals of Boekaerts (1982) and Klauer (1985). For the third 
teaching task we extrapolated from theories of Brown (1980) 
Hettema (1979), Lawson (1984) and our own research. The fourth 
task (feedback and judgement) comes from Gagne (1977) and the 
last one (keeping students motivated and concentrated) stems from 
research on teacher perceptions of their tasks. We believe that 
Kuhl's theory em mind- and activity-orientation forms an impor- 
tant tool in conceptualising this last teaching task. Apart from 
external distractions which draw the students' attention away 
from the learning task at hand, mind-oriented cognitions form 
distractors , too. 
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I Prepirmg lemming * Orientation on goals, 

strategies, time, etc. 

* Planning of learning 

{time, anticipation of 
problems, choice of 
strategies) « 
Gaining attention. 
Promoting self-confidence. 
Informing students on goals, 
stimulating recall of 
TT _ , . prerequisite learning 

II Facilitating learning * aimed at remembering and compre- 

hension. 

* aimed integration with other 

information. 

TTT « .. . . . * aimed at problem solving. 

III Regulating learning * Monitoring. 

* Testing and questioning. 

* Revision (re-orientation, 

diagnosing, reflecting, 
repairing) . 

tu r* • - • JL * Ev «luating learning processes 

IV Giving feedback and 

j udging performance 

V Keeping students concentrated 
id. motivated 



li A categorization of Teaching Tasks 

Teachers should be alert to mind-orientations such as goal- 
ixati^n, Planning-fixation, failure-fixation and success- 
1m .'Z™' Moreover, they should try to lead students towards 
activity-orientations in which the goal-state to be reached the 

EE n «»2 t ftr--i th VS i I fer-n £ - between the aosl and the present 
n?£ %E the plan that may be used to change the present state 
? St J te w each get sufficient attention. One aid they 
night use to reach these states in students is goal-setting 

i J tlon '- in ° ur ©Pinion, thus pertains to the 

tent to which one is able to be one's own teacher. This means, 
ccordiiig to the scheme of teaching tasks presented- being able 
prepare one s own learning, to take the necessary steps to 
« aim:Ln, 3 , at recall and comprehension, integration and 
Si ^ I 1Rg i' t0 re ^lmtm learning, to provide for one's own 
H^?S^ and judgements and to keep oneself concentrated and 
m Zft-' i °" r conception( see also Hettema, 1979; Lawson, 
!!? levels or perspectives in respect to these tasks 
S«-^ e dl! ; Cerned (see liffure 2): imetacoaniHye) knowl,d^ ' mn * 
t lons Cfer instance knowledge of study strategies, knowing 
en to use certain strategies, or conceptions of self-regula- 
tion), executive control or regulati on BroMi... (for instance 
deciding on a plan, attention-maintenance, monitoring, or reeair- 
miehani^ms) and transformations or e xecutive skills (for instance 
!!S!? r S S i nff ' unde f lin ing, or reading), in agreement with Lawson 
(1984) and recent Russian theories (e.g. 2ak, 1980) we assume 
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that metacognitive knowledge arises from reflection, (being an 
executive control process itself) on executive control promises 
or transformations. 



(metacognitive) knowledge 
and conceptions 



executive control 

or regulation processes 



transformations 



Figure 2: Three perspectives and their interrelations 

The most extreme form of self regulated learning occurs when 
students perform all of these teaching tasks themselves. Most of 

i^v! 1WC ' h ° W r er ( t ° 1 achers (or the " substitutes, for instance 
books or computers) take care of at least part of these tasks In 
essence, there always seems to be a division of tasks. Extension 
fLi reg P° n f lbll ity of students for their own learning may in 
-a X*" i m 5 rove learning. Lodewijks (1981), for instance 
showed that students learning science concepts in a self-chosen 
sequence performed better than students learning these concepts 
in a predetermined sequence. Likewise, Van der Sanden (1986) 
showed that some students (especially the better ones) performed 
tft^ 5 raC ^ leal ? 0 ? str uction task without instructions than 

with detailed and explicit advice from a teacher 

According to these and other studies improvements of 
learning might be reached by giving students more opportunities 
to regulate their own learning. This, however, is problematical 
in practice . Apart from the students who might profit from these 
opportunities, there are also students who will perform (still) 
worse when teacher advice is absent (Lodewijks , 1981 Van der 
Sanden, 1986). A differentiated system with opportunities for 

!S,,?" re f 5i 0n f f r the better Performing students and sound 
advice for the weaker students, however, encounters many practi- 
?fL,? 1S Vantafles and Problems. As vas discussed by Larsson 
(1983) paradoxes of teaching should al.u be taken into account. 
Some teachers would like to give students more freedom to learn, 
but do not believe that students are able to handle this freedom. 
Some students believe that only the teachers should make deci- 
sions on learning and seem to hand over all responsibility to the 
teachers. In our opinion there is only one way out of these and 
«. Pa ? adoxe * and circularities and that is by training 
J ?2 t^ Xn w self " re ff u lation. One main goal of training programs 
should then be to convince students that they have a responsibi- 
lity for their own learning and that they can become able to 
regulate their learning. 

Before such training programs can be developed, however, we 
need more information about individual differences in self-regu- 
lation. As yet we do not know to what extent students have the 
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"Si** a C ° n " Pfcl ° nS and metacognitive kncw.e.e ■ Ac, we know 

£rL?™ «• in regulation pr«*e**,r . S jod "raining 

programs, in our view, should depart fr-. a aounc iifwoiis !? 
the entering behavior of the students "W " also and 
Armbruster, 1984). Our research strategy rt*. ha., " ^i^o SSt S» 

S Ca ih. la .f?? th St ^ eS ' — hing 9 ?~ ^"tdSE iifflren? 
ces in the self -regulation of learnilnw, desi-tnina oartial 

du?i 0 F?} Cal trainin * aiming to influenza ISIae P iSlivi- 

dual differences and evaluating the result* of trail ^ng in terms 
of process- as well as performance dif f e*«4#«s '" 

The main research questions wir«; a) w»*t individual 
differences in self-regulation occur anc mt'.vh j£ tliese relate ?o 
performance differences? b) is there an .fr i„t on 
process- and performance-variables? In tr i studies reportel 
accentu^ed. middle ^ ° f FiffU " 2 <* -cu^ve "onSSlFS 

In designing training programs we had the following 
starting-points: a) We based the training on the dilf erfneeTin 
processes observed during a pretest-session b? We stressed 

«? 9 ^^•• 3WaJreneSS by letti »ff stents reflect on tne" own 
way of learning and that of other students, c) We emphasized the 
importance of regulation processes by letting stulentS^rlf ticl 
71 2 n„ r * Qt fc « u J sti ?ns one may pose oneself during learning 
?° understand this part? What went wrong? Is this in linf 
E2uf In i« arning g °" 1?) and techniques and skills one may find 

t'on thlnJSr o? S * qU ? Sti ° nS (e ' ff - P^aphrasing, reflec- 

tion thinking of new examples, self testing) , d) Finally non- 

tionfanl minder? 8 —Nation, self Motivation? "ftrSS- 

tiorw and mind-orientations were also included when possible. 

STUDY 1 

METHOD 

Subjects 

I hS §u ^ e cts were 14 students from the second year of 
an! 7 girls? **" fr ° m 13 to 15 ■ The " ^ 7 bojj 

Materials 

«.«. ^ . th i S study thre> smtm °* learning tasks were used 
thought to be representative of academic talks used In S 

taskrLnfi -! e S 0n 5 a f y SChools Compare Doyle, 1984). The Earning 
t inl'f Parallel texts of 900 words on probabil?? 

ty, the one introducing principles, problems and examples of 
chances with replacement, the other dealing wi?h cSancJs wlthoSf 
replacement, two sets of 20 French words and their EStch trans- 
lations and two parallel problem solving assignments in which 

Ifie^pSed 11 ^ fhese iPleS ^^roduced^n a slparSte ' text ) hid 
X. t a P plled ; In these assignments students were to calculate 
the number of correct answers to multiple choice tests on the 
basis of guessing. Following Olshavsky (1976), rll do^s werS out 

Text atlL^ t&KtS Whe " v«rb.H».tion was thought crlllll. 

Text comprehension was tested by means of two multiple-choice- 
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ie^nt-i^ ii.-i*?" - f ach ' • ewphasisinsr nfl&mzt&ingrts instead of 
«5 ?• t J°f« bular y- le »rnxng was tested P* leans „f = a randomi- 
Sutch" * 5h.° f th » F "» ch that Stttd^i had to t =ran s latfin 

?"|??\? he # qua ;; ty of the Problem solving outcome * was used as 
indication for the result on the assignments, 

For the training program two cage^blsteries v.were written 
2d X 2 ! t0tal ^ y different ways of ' X 0v * Ba . \ VpalsiJe wly 

and an active way incorporating several a#LHia 9 nost-ie routines 
and heuristics. Also a short booklet was wtttin in sWiirt , s 

(e.g. What do I already know of this ssub ect~maf? ter'" "Hhv 
2S-f I M und#rStand thls part? " ftnd " ^ich Mt s r V if i cult lor 

on possible ways to answer these que*tie* ( . FinaUyTT a set of 
practice materials (texts, words and prefer,! „a t . constructed 

Procedure 

eeed Jr L° n ! o? ° ne b ff iS students « nd < t»«l «cperlnMnter» pro- 
ceeded as follows after regular school tours : af titer a short 
introduction each student was asked to iea^one of the texts 
one set of words and to solve one set If golems. They were 
asked to read and think aloud and to ,ay out iSi^id whatever 
thoughts occurred to them. They were t^d that the test items 
would pertain to comprehension and application afteid not to 

SSS^S -° f » £aCtS ^ A i X th> subJe5t«e W b^i?S?ioSfwere 
taped „nd their observable behavior was tme&fei y>y t-he experi- 
menters. Afterwards the tests were complete. p 1 

Half of the students participated as «, group, in th am trainino 
program, which occupied three hours in all, 1 th. firZ-st session 
two ?"" P >, dl ? CU ? Sed * lf ? er-nt Ways s£ stud^itaj, ineorpo^rating the 
^udS^r? 1St0r 5 eS :. DUrinfl th ' Second fc hird sessions the 

It, learn J d the set of questions a ^ the pcrtK.le ways to 
expelrLenter pracfclCed these - receivir** feedback - from the 

?2Ln*S i^- Weok 5- aftS ^ fc ^ e draining, t&fc parallel-* tasks were 
' reading and thinking aloud in individual sessions. 

Finally, the parallel-tests were complete^, 

Design 

The design was a non-randomized fereUst-posttesast control 
group design. The training was administer i0 t h e suSLt^ that 
were most in need of it according to the vWhea^a.tSir ~ of th- 

SSl? 0 i;-Sl* r S B ; n i nff -i" tUd S at ? thUS f ° rn,e4 a A rou P for comparison 
only instead of a real eontrei group. 

Data-analysis 

eftm hnnf5 bal a prot °^ ls and experimenter's observatiions were 
*" " „ flrst ste P- u «its of auaysla were determined, 
following a procedure proposed by Wouters »u de Jojing (1982), 
which stressed meaningful units rather tj, W wttncis. The dita 
were categorized using the categories pr««#bM~ in appendix 1 . 

ao De nd^°? S K? eX ; mpleS ° f the "t.tfCtfi,, ar e p« .Lnted in 

appendix 2. Intercoder- agreement was 8 8 percj#jat, 
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Ta-sble 1 pr 

only, 

l£iL r=L 4. M T!! n • reqUencies of P"ee««e« in protocols of good i and 
weaker Sm (during pretest-session) . 



^ - - ,. sents B he average results on the three tsskss for 

good **nd weaker students separately, for the main MegSries 





Text 
good weak 


Vocabulary 
good weak 


Problem- 
solving 

good seak 


Honlt=©ring 

Te#ti ^ng 
Ptagn nosing 
Evalu mating 


53.4 50.3 
1.4 3.7 

25.7 25.3 
6.7 8.1 

21.6 24.0 
6.7 5.7 
0.7 1.6 

116.3 118.7 


18.7 21.7 

2.5 1.3 

8.6 4.7 

9.1 19.1 

27.8 9.3* 
0-4 0.3 

2.2 2.7 

69.3 49.3 


14.2 8.6* 
10.8 4,6* 
9.0 3.5* 
12.6 4.6* 
3,4 2.6 
0.6 fl,8 
0.8 0.9 

81.4 25. S* 



me ««« no differences in frequencies on the main eatearar— lea 
FSS^SS "testing Ss in text=processing. 5owe\ e tlZSin 
s dfniS 9 ?fL^ testlng " a significant difference showed up, Wood 
SS 11 % o vJTd ? q n^^ y J>\ un ^«tanding than ww-k.r 
-Se^n 0 knowLdge^ 11 V ' ~ ^ 

STSStg . teStlnS di « e "» tia ^ wod iro^weake/subU^ X St 

«H thS Iflferlnti^f" 1119 ' ?°"? V * r ' the entity oftMteino 
XL 2? fj fferentl ating variable. Better students tested ths-ree 
tils smm often as weaker Ss (27.8 vs 9.3 p< .0*5) Di LenSls 

She B t=Ital JSL?*? ^ ^ the P^lem-solving 'til KISSS 
to the t=otal number of processes registered, and the nutober of 
nnaiton-ng, regulation and orientation-processes 

The-- training program had a significant effect (p< 05) on ttthe 

SSra"? tlr° f PI StUde P ts on th « comprehension ^tes 'admiSJ- 
stsred a ?fter studying the text. The trained group inereaaed 
aviragt ; score with 2 points (out of 13), wh.lels the c 0 pariSon 
i:ftL e ^ alned °" the Same level ^ in the P ri? s f SS 
a t*S'^ 8n Vocabulary - test «»d the problemsolv ng-tEsk 

f«rouS inCr0aS ° in the training-group, nor in the celpar-f* 

ub in* h JJ*,i raininSr e " ect on the ^Prehension test also showed 
tLX«- Pjocess-data. in the training group the number of 

twtjnw en understanding increased from 10.0 to 20. S (p< 05? a^nd 

ti hsl ^iSuri 1 ?? 8 °? kn °r iedge d ?««^«a ^om t °?i rt n o 

ShcIi^S. ' ' In comparison-group no change, in 
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Mean 

Frequency 
22 — , 
20 — 
18 — 
16 — 
14 — 
12 — 
10 — 

§ _ 

6 _ 

4 _ 

2 _ 

0 



CoiQporison group, understanding 



under- m t anding 
Trained rroup 



knowl edge 

Comparison group, knowledge 



pretest posttest 
session sesiien 

Figure 3: Mean frequencies of testings before and after training 
DISCUSSION 

This study revaled loine interesting relations between 
performance and individual differences in executive control 
processes. In text-processing the tuning of self-diagnostics to 
the learning goal proved to be toe most important aspect. In 
vocabulary learning, however, the amount of self testing differen- 
tiated between good and weaker performing students. In the 
problem-selving-task both monitoring, regulation and orientation 
processes showed up more frequently with better 3s, Thus, 
individual differences in processes correlating to performance 
were task-dependent. Training proved to be effective for the 
text-processing only, both for perff ormanci- and process-data 

Three cautionary notes iheuld toe made. First, because of the 
small number of Ss participating ir*. this study, replication on a 
larger scale is necessary. Currently wt are doing so in a study 
with 64 Ss. Second, one should be* wary of cause and effect- 
relations* The quality of executi. -ve control practises may cause 
the ef fectivity of task-performance- . In case of the text-proces- 
sing data we have reasons tobelifc-ve that this is whkt happened 
Apart from the correlation between performance and processes, 
there also was a change in the number of testings on understan- 
ding (induced by the training program) coinciding with a change 
in performance. For the other -two tasks, however, the causal 
relation might also be in ths rivtrse direction. Weak performance 
(for instance caused by low abilities) might cause the occurrence 
of particular processes, like noticing negative results, or 
keeping on planning. Therefore, a distinction between good and 
bad executive control-processes would be helpful. Kuhl » s distinc- 
tion between mind- and activity-oriented processes might form an 
improvement (see the next studies). Third, one night also argue 
that relations between performance and self-regulation processes 
should not always be expected, Some ways of processing might be 



preferable to others without leading to better performance , for 
instance because they are mw efficient, or because they keep 
processing going in difficult circumstances. 
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The results of the present study also suggest the imoortancp. 
of on-line processes for self-regulation as Uposed to p?ScIs«s 
occurring at the start and at the end of leaning Ferienfallen 
oi the ?^i° n) * " any trainin ^Programs stressed the importanel 
?f™ J*. J e f P" ce ! ges - Nevertheless, in the present investiga- 
Sfl,5 @f0re .- nd a " er Processes a) did not occur vl?y 
cf lid nif ? n n0t dl «« r J nti ^ between good and weak students 23 
^nn^f 5 "crease in frequency through training. The opposite 
counts for on-Hne processe. such as attesting during lelrnino 

de Sl gn of the training study was? due tl prSticai 
arrangements, not optimal. In future studies a real control areuo 
consisting of untrained weak students, is to Se prlfelreS 
Moreover training should be extended in time, particularly as to 
the vocabulary and problem-solving parts. Also transfL- and 
long-term effects should be taken into account ^ansfer and 



STUDY 2 
Introduction 



the fir 1 , fW thli study wer « about the same as for 

J,, -J stud y* Now ' however, transfer effects were accentuated 

Furthermore, an attempt was made to discern good and bad refla- 
ting processes, using Kuhl's theory on mind- and activiiy- 
«r^n^ l ° n - ' The "tegorization-scheme was extended witJ m^d- 
oriented processes (directed to failure or success exoeiienc. or 

me« Ua or° n Sx 0f hatI '* ^V*" " Th " - ~ E? f icult'fel 

Tl- #= or I hate these sums"), and task-irrelevant statements 

l™^?^ 1 " 1 '* Mo «^ er ' Processing-measures were relateltl 
impulsivity, concentration-ability, verbal intelligence and 

w^rsrSubfecK 1 ^ mrm^ om a schoel ofi gpec iai ~ s 



METHOD 
Subjects 



™ bQ P Crom a secondary school for special educa- 

tion They were selected because of their weak loneintrition 
abilities. Ages ranged from 12 to 14 years, concentration 

Materials 

In this study arithmetic word problems formed i-hm mmir* 
learning materials Because of the learning Sis.bi^tfes If "Se 
Ss, the tasks used m study 1 could not be used. Arithmetic word 
problems were chosen because of the difficulties they pole lor 

r^stricfthftSir' 8 / a ^ di ^to the teachers), we wanted to 
restrict the training to one type of task 



^ ciininy no one type of task in order to prevent 
confusions between strategies for different tasks. In tStal 11 
word problems like the following constituted the Si^J 
material: - A train departs at 21^47 hours. Traveling time ?s f 
hours and 36 minutes. At what time will the Irail lr"rive?« 
Another set of 7 of these story problems formed thJ pretest and 
2 V were the Pattest. Also, both at the pretest-session 

and at the posttest-session transfer-tasks were administered- ti 
fraction-problems like 4/.. -6/9 and 2 problem-solvf nltasks 
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These tasks consisted of a description and a drawing of a route 
to be taken, for instance from school to home. On the way some 
other things had to be done, like visiting a library, shopping 
delivering something to a friend. Several time-constraints as to 
how long a certain route takes, how long you need for a task or 
when something had to be done (e.g. the shop closes at 18 00 
hours) form the data to be used. The Ss task is to find the 
fastest way home. 

The following standardized tests were usedi a concentration 
test (Bourdon-Wiersma) , an achievement test (FMT-K) f de Hatching 
Familiar Figures Test (MFFT) and the verbal analogies-scale from 
an intelligence test (DAT) * 

The training program was like the one in study 1. Now 
however , concentration problems were discussed, too. Feedback was 
intensified by recording problem-solving on vide© and discussing 
the recording with the Ss. 

Procedure 

There were 4 phases in this study, In the first individual 
session ^ (taking 2 hours) the tests were administered. Also Ss 
were trained in thinking aloud, using materials comparable to the 
ones ussd in later phases* 

The second phase constituted the pretest-session {15 
hours). Now, the arithmetic word problems and transfer tasks were 
administered, subjects thinking aloud all the time. 

In the third phase only half of the Ss participated As a 
group they were trained during two sessions (4 hours in total), 

Finally, the individual posttest-session took place. A1110 
Ss again solved 7 arithmetic word problems and the transfer 
problems, thinking aloud all the time, 

Design 

The design was a pretest-posttest- control group design with 
random assignment t© the two conditions. 



RESULTS 

Table 2 presents the differences in processing between good 
and weak Ss, As to the arithmetic werdproblems no significant 
differences appeared, though weaker Ss uttered somewhat more 
mind-oriented and distracted statements, For the fractions 
differences showed up as to execution and control. The difference 
in frequency of mind-orientation was not significant. For the 
problem-solving-task a similar phenomenon showed up, but now in 
the reverse direction. Good students had higher frequencies in 
these processes than weaker Ss. Overall the mean number of mind- 
oriented and distracted cognitions were rather low. 
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Table 2 i Mean frequencies of p rQC 



esses for good and weak Bm 



Processes 

Execution 
Control (1) 
Mind-orient , 
Distracted 


x bfiiuc tie 

wordproblems 


Fractions 


1 — ; 1 

Problem 
solving 


good weak 

20,5 24,0 
12,8 13,3 
5,3 8,5 
1,8 2,5 


good weak 

19 .6 39,0** 
8,6 26.0^ 
4,4 11,6 
3.8 3,8 


good weak 

17*4 5,8* 
14,6 4,6* 
1*4 0.2 
4,8 0,6 


(1) Control^ A pooling of monitoring, regul 
p< ,05 


ation, testing 



ite) 



* -.05<p<,l0 



5 f u" S between flood and weaker students covaried with 
the Matching Familiar Figures scores ( cova " ed Wlth 
fractions) , (see table 3). - gUres sco «s ( word problems and 

Table 3: Mean differences between good and weak Ss on testscores. 





Arithmetic 
wordprobleins 


Fractions 


Problem 
solving 


Tests 


good weak 


good weak 


good weak 


Achievement 








motivation 
Intelligence 
Concentration 


4.8 5,3 
13,8 15,0 


4,0 5.6 
12,6 16,0 


6,0 3,6 
14,6 14.0 


errors 
Impulsivity 


25,0 31,0 
4,5 6,8* 


27,4 29,4 
4,6 7,0* 


22.4 33.8 
5.8 5.8 



testscores an w «e "oof linld^I a b *!P en Process-f requencies and 
impullivity I"relatS with ? h th- f" rithinetic werd=problems t 

ana r-.6g, p<.05, respectively). p - ,U3 

from tabif i ni SInf °l£ a the ai en d i t0 * ffective ' as b. seen 

scores as covariatl s «nd posSest-scolL^s^d 3 ^ 6 ^ 1 ^ ^ etest = 
reached stiti^firai «V™.i5.- scores as dependent variables 

thi^tS .bi B sUi;s e ^ ,f K:s::-dis r :j ,,d ^ ia 

u„ lnte „ded direction. ln the SK^^V^!^,^" 
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increase, instead of a decrease in the mean number of mind- 
oriented and distracted statements appeared. Since there was no 
effect on the process- and performance-data of the arithmetic 
wordproblems , no transfer to the fractions and problem solvina 
tasks showed up, as could be expected. 

Table 4: Mean pretest and post test results on word problems in 
the trained and untrained groups . 





Trained 


group 


Control 


group 


Variable 


pretest 


poittig t 


pretest 


posttest 








Performance 


2,0 


3,2 


1.8 


3,0 


Execution 


21.0 


24 .2 


25,0 


21.6 


Control 


12,2 


13,0 


15,8 


13,2 


Mind- oriented 


5,4 


8.4 


9,6 


8,0 


Distraoted 


3,8 


8,8 


1,6 


3,6 



DISCUSSION 

This study revealed some differences in regulation-processes 
between well and less wall performing Ss. The differences in 
mind-orientation and distractability that we had expected were 
however, too small to be significant statistically. The scores 
for mind-orientation and distractability were rather low. 
Training failed to be effective this time. No effects of training 
on performance or process-data were found. 

The process-data on the fractions and problem-solving task 
seem to suffer from the cause and effect problem discussed before 
in a previous section. The fractions posed such great problems 
for some of the Ss that they tried over and over, noticing 
negative interim-results and being rather mind-oriented. The 
problem-solving task on the other hand was so difficult for some 
Ss that they did not do anything at all; processing stopped 
without hardly any verbalization. It seems then that differences 
in processes depend at least partly on the (subjective) diffi- 
culty of the task. 

We did not succeed in finding a suitable operationalization 
for distractability. Students who were selected because of their 
c ncentration-problems verbalized few task-irrelevant cognitions. 
This might be an artefact of the thinking aloud procedure 
Probably the necessity to verbalize keeps students concentrated. 
In spite of this, still a significant correlation with the 
concentration-test showed up. 

The number of mind-orientations was also rather small This 
may have to do with the fact that they were ©perationalized on 
the level of single statements. Kuhl, however, defined the 
distinction between mind- and activity-orientation on a more 
molar level. He defined activity-orientation as a state of mind 
in which both the present state, the goal state , the difference 
between these two and the possible actions get attention from the 
subject and mind-orientation as a state of mind in which a 
fixation on one of these four elements occurs. Perhaps than a 
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mora holistic approach in analyzing protocols should be prefer- 

Whereas in the previous study with "normal" Ss at least 
some affects of training showed up, in this study with students 
It ■ T r Zt ng Problems no significant training effects were 
obtained. This might have to do with the difference in subject? 

shSuid iSI- ™ erha f? f ° r ch J ldr r with 1-rning problems training 
« in tJi I„^ 0r J , tlme ° r Sh ° Uld differ in a PProa C h (for instance 
as in the suecesfui program of Falinesar and Brown, 1984). 

STUDY 3 
Introduction 

In this study an attempt was made to solve some of the 
problems encountered in the previous one. Mind-orientation was 
op.rationaliz.d differently. Instead of registering single minS- 
SEE £ St !* 6 ^ ntS ' , now P-tterns of statements ware sought Sat 
might am indicative of mmd-orientation. Therefore, there was no 
separate category for mind-oriented verbalizations. Th. tracing 

l!ke ra rec?LS a ? ge ? C °" Siderably ^ incorporating new alemamt"! 
. *? .Reciprocal teaching procedures (Brown & falinesar 1984) 

S2i«f Ua i. 1 " rninB I° alS ° n Protocol, collecteldurlng a 
pretest session and modeling. As a consequence of this, the 

studt^ twice as time as in the previoul 

METHOD 

Subjects 

The Ss were 4 boys and 2 girls from a school of special 
education, selected out of a group of 45 students on the balil of 
t„u ■ f eria C , We ? k ooncentration according to the teacher and the 
schoolpsychologist, impulsivity (MFFT5 , age (12 years old) low 

tical V ability° tlVati0n ' test '» nxiet y » nd sufficient mathema- 

Materials 

As in study 2, arithmetic word problems formed the learning 
K5*5 al " P °L ^ e P ret « st 3 word problems were used, as wis So SI 
tor the posttest. Reading-comprehension was used as a transfer 
measure Both during the pretest-session and during the posttest- 
oth^°on S i? " udl * d ? text of 3 pages (one on "old times" tL 
about iL contfnts eV8nlnff,,) answ «" d op.n-.nded questions 

h» a ^ F °% al L S ? individual learning goals were fovmulated on the 
5 L °? ? h- " Pretest-protocols. For each individual training 
session a script was prepared, concretizing how the individual 
learning goals could be reached. The elements included in the 
stSdSJ?! W ^° : ^ ecipro f al baching procedures, experimenters and 
students changing roles, modeling, awareness training, direct 
rSSu^nV" regulat ^ on mechanisms, prompting, and feedback on 
^^h^ ^cesses In two group sessions (N=3) students worked 
together end discussed their regulation processes. 
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Procedure 

The first session was a pretest-session, It started with a 
practice in thinking aloud when solving a wordproblem, Ss were 
taught how to think aloud, receiving feedback, Then the three 
trordproblems were solved thinking aloud. During the second 
rjession, the text was read, again thinking aloud* Directly 
afterwards 8 comprehension-questions were answered on the content 
of the text . The third session took place after 10 days and 
constituted the first individual training session* In between the 
thinking aloud protocols were typed out and analyzed in order to 
formulate the individual learning goals, This session was devoted 
to awareness-training, following the procedure used in study 1. 
The fourth session (2 days later) also was an individual session, 
Now three word problems were solved, following a reciprocal 
teaching procedure* Two days later a group session (6 students 
and 2 experimenters) followed. Regulation-processes were modeled 
by the experimenters* Stude^;s were stimulated to work together 
and to be each other's external monitor* Also, important conclu- 
sions from the individual sessions were repeated and discussed. 
The sixth and seventh sessions again were individual training 
sessions, the procedure being the same as in the fourth session* 
Different kinds of word problems were used as training materials. 
The eighth session was another group^session (like session 5). 
Students now learned the differences between five kinds of word- 
problems* Furthermore they wrote down what they thought they had 
learned from the training. The final session was the posttest- 
session, and identical to the first session* 

Design 

The design was a pretest^posttest design. Due to practical 
circumstances no control group could be used, 



RESULTS 

The training resulted in a significant increase in scores on 
the arithmetic wordproblems (from 2,1 to 5,5, t=2, 50 ,p (one- 
tailed) <,05), Transfer to the text comprehension performance, 
however, did not occur (H^pretest 4 * 9 , M-posttest 4,9, n*s,), 

In table 5 frequencies of the different processes per 
subject are presented, both for the pretest and for the posttest- 
session* Ss 2 and 5 increased their number of verbalisations in 
almost all categories, These were also the 2 Ss profiting most 
from the training in terms off performance improvement, Ss 4 and 6 
increased their number of execution-, regulation- and testing- 
statements* Subject 1 increased its number off execution and 
testing verbalisations and for subject 3 an increase in the 
number of orientation and regulation statements could be noticed 
and a decrease in the number of monitorings, These changes did 
not occur as to the verbalizations during text comprehension, as 
may be seen from table 6* 
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Table 5: Frequencies of the different processes, before and after 
craining (arithmetic wordproblems ) . 



Subject 






pre 


Process 




Execution 


18 


Orientation 


11 


Monitoring 


20 


Regulation 


13 


Testing 


2 


Diagnosing 




Evaluation 




Distracted 


4 



Subject 

Process 

Execution 

Orientation 

Monitoring 

Regulation 

Testing 

Diagnosing 

Evaluation 

Distracted 



1 




d 




3 






pos 


pre 


pos 


pre 


pos 




32 


25 


65 


58 


57 




11 


7 


16 


8 


12 




20 


11 


44 


31 


21 




11 


6 


30 


24 


29 




8 


2 


11 


5 


1 




1 


1 


1 










1 










2 


1 









pre 
7 



pos 

23 

1 

4 
14 

6 



pre 
5 
4 

a 



pos 

230 
55 
164 
93 
32 
7 
2 
5 



pre 

1 

5 
10 
2 



pos 

18 
2 
7 
8 

2 



Table 6: Frequencies of different processes 
training (text-comprehension) * 



before and after 



Subject 


pre 


Processes 




Execution 


26 


Orientation 


5 


Monitoring 


7 


Regulation 




Testing 


1 


Diagnosing 




Evaluation 




Distracted 


3 




16 



15 



Subject 


4 




5 






6 


Processes 


pre 


pos 


pre 


pos 


pre 


pos 








Exeeution 


24 


39 


33 


30 


12 


37 


Orientation 


1 




4 


5 


4 


8 
11 


Monitoring 


5 


4 


23 


20 


9 


Regulation 


15 


15 


20 


17 


5 


21 


Testing 








2 




1 


Diagnosing 






1 








Evaluation 








2 






Distracted 








5 







In order to find changes in mind- and activity orientation 
the thinking aloud-protocols were analyzed per word-problem and 
classified according to the 4 kinds of fixations discerned by 
Kuhl and mentioned in the introduction, The results are presented 
in table 7, There were more activity-orientations afti 
(chi-square=6 , 9 ,p< . 01) , 



:er training 



Table 7: Classification of wordpi^blem protocols according to 
rnind- and activity-orientation 



Orientation 


pretest 


pos ttes t 


Mind- orient at ion 


16 




7 


Goal- fixation 




11 


3 


Failure-fixation 




3 


3 


Planning- fixation 




2 


1 


Activity-orientation 


2 




8 


Unclassif iable 






3 



The number of negative and positive self -statements were also 
eounted.The number of negative self-statements decreased from 
pre- to posttest for 3 Ss during the solution of the wordproblems 
and for all Ss during text comprehension, There were no increases 
in the number of positive self-statements, 

DISCUSSION 

The training this time did have an effect on performance, 
though transfer to the reading task did not show up. Of course we 
cannot be certain that the increase from pre- to posttest was 
caused by the training, since there was no control group* Since, 
however, differences between the thinking aloud protocols of the 
pretest-session and the post test-session, that could be related 
to the training, were also observed, we have some confidence that 
there were real training affects. Furthermore, the Ss stated that 
they learned a lot from the training, 

Finally, it should be noted that we do not know which 
elements of the training were responsible for the obtained 
effects. Further research is needed to clear this up. 
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CONCLUSIONS 
In 



«= *. , ° £ Some methodological problems (like the influence 

of task-difficulty) still some interesting individual differences 
in control processes could be discerned. These differences 
?®^ a i n !? t0 quality and quantity of testing, the breadth of 

orientation, the amount of on-line regulation, mind-versus 
activity-orientation and distraetability . Under specified 
circumstances these differences correlated with performance 
differences and testseores (especially impulsivity) . It seems 
possible to change these individual differences through training 
even in students with severe learning problems, The exact nature 
ol optimal training remains, however, somewhat unclear 

Further research is needed on the questions underlying the 
studies reported, m our present studies thinking aloud protocols 
are collected in greater samples of Ss, using training programs 
of longer duration and also addressing the methodological issues 
mentioned before. 

Footnote 

1) The studies reported in this paper were executed by the 
following students of psychology: Jan Vermunt (study 1) Ingrid 
Eijkelkamp and Connie Senden (study 2) and Antoinette de Bot and 
Mu-iel Baal (study 3), 
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APPENDIX 1: Definition and examples of main 



categories of processing activities 



CATEGORy 

1» Execution 



2, Monitoring 



2- Regulating 



3 B i, Plan 



ning 



DEFINITION 

all cognitive and overt 
activities transforming 
states of knowledge or 
understanding in the 
direction of aimed states 

perceiving t interpreting 
noticing characteristics 
of executed actions 

choosing activities and 
objects on which activities 
should be performed 

regulation on a macro-level 
before text processing 



3.2, On-line regulation regulation during text 

processing 



4 S Orienting 



5. Testing 



5- 1 - Testing on 
understanding 



5.2* Testing on 
knowledge 

6# Diagnosing 



7* Evaluating 



preparing oneself for the 
task by inspecting the 
learning situation, possible 
activities* goals and oum 
character isti os 

all activities leading to 
information about results of 
learning 

all activities leading to 
information on under— 
standing 

all activities leading to 
information on knowledge 

looking back at a pre- 
ceding learning process in 
order to discover why 
results are (not) reiched 



EXAMPLES 

- reading 

- I don't think this is an 
experiment 



-oh yes, I understand 
- this is very difficult 



- if 1 read this very 
thoroughly I shall 
understand it 

~ I'll Just read on, perhaps 
I shall understand it 
later 

* ujill there be a test? 
~ oh, I'm very good at 
multiple-choice tests 



~ y^s, this seems to 
follow from this table 



paraphrasing 



judging the total learning 
process in relation to the 
goals 



- reproduction of text- 
fragments without reading 

" I Just don't understand 
how this figure has been 
constructed, but that is 
because I am no good at 
mathemat i cs 

- no, I don't understand 
all of it, but enough to 
pass the test 



ERLC 
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APPENDIX 1.- scheme of ( subcategories used in protocol analysis 



1 . Ejcecut i on 

1 . 1 , reading 

1*2. rereading 

1.3- imprinting 

1.4, addition of information 

1.5, comments 

1.6, asking for explanation 

2* H on i tor ino_ 

2.1, noticing positive interim-results 

2.2, noticing negative interim-results 

2.3, noticing characteristics of the task 

2.4, noticing own actions 

3- Regulati on of the learning Process 

3.1, planning 

3.2. on-line regulation 

3.2.1, choosing new activities 

3.2.2, selecting information for extra attention 

3.2.3, a combination of 3,2,1, and 3,2,2, 

4 S Or ient in^ 

4.1. exploration of text 

4.2. asking for information on goals 

4.3. reflection on own characteristics 

4.4. actualizing knowledge on possible actions 

5. Testing 

5*1* testing on understanding 

9.1.1. paraphrasing 

5.1.2. comparing on internal consistency 

5.1.3. comparing own conclusions with text 

5.1.4. solving example problems 

5.2, testing on knowledge 

5.2. 1. reproducing 

5.2.2, comparing reproduced knowledge with text 

5.3, checking of solutions of problems 
5-4, generating questions 

6, Piagnosinja 

6.1, relating results to characteristics of the task 

6.2, relating results to actions 

6.3, relating results to own characteristics 

6.4, specifying learning results 

7m Eva lust ir%^ 
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